DOCDMENT RESOHB 

EA 006 197 

Bettinghausr Brwin 

Preliminary Field Study: Oisseaination of Educational 

Accountability. Final Report. 

Michigan State Dept* o^^ Education, Lansing. 

Colorado state Dept. o£ Education, Denver. 

Cooperative Accountability Project* 

73 

48p. 

MF-$0.75 HC-$1.85 PLOS POSTAGE 
♦Comaunication (Thought Transfer) ; ♦Educational 
Accountability; Educational Assessment; ^Educational 
Experiments; Educational Research; ♦Information 
Dissemination; Models; ♦Program Evaluation 



In 1973 the Michigan Department of Education and the 
Cooperative Accountability Project attempted to develop a greater 
understanding of the problems which might be associated with 
dissemination of information about educational accountability 
programs. From this project three papers resulted that outlined a 
potential dissemination model designed to be useful to local 
educators in communicating elements of any educational accountability 
model. The model vas tested in 1974. This limited test was aimed at 
investigating the reactions of participants at the local level tq 
attempt to train them to disseminate elements of the model. This 
report contains: (1) a brief statement of the project's 
accomplishments^ (2) an evaluation of the project prepared by the 
project evaluator, (3) a budget analysis, ^^) recommendations for 
future efforts in this area, and (5) an appendix containing the 
materials produced for the project. (Author/JF) 
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INTRODUCTION 



Tvom January 1, 1973 to June 30, 1973, the Michigan Department of Educa- 
tion joined with the Cooperative Accountability Project, Denver, Colorado, in 
an attempt to develop a greater understanding of the problems which might be 
associated with dissemination of information about educational accountability 
programs. The Michigan Department of Education, under the overall supervision 
of Dr. Thomas Fisher, contracted with Dr. Erwin P, Bettinghaus and Gerald R» 
Miller, fipom Michigan State University, to produce a series of three papers 
entitled "A Dissemination System for State Educational Programs*" Following 
the completion of the three major papers, a fourth paper, "Reactions and 
Authors' Comments on Reactions to the Papers Entitled 'A Dissemination System 
for State Accountability Programs*" was prepared during the period July 1, 
1973 to September 1, 1973 • This report summarizes the commei;ts of three non- 
project reactors to the original three papers together with che comments of 
the two authors. Following the publitaticn of these papers, and the reactors 
comments to the papers, a monograph v^as published by CAP which condensed the 
three part series so that it could b^ made available to a large audience. 

The documents produced by Bettirtghaus and Miller outlined a potential 

y- 

V 

dissemination model designed to be useful to local educators in cormnunicating 
elements of any educational accountability model. However, the model devel- 
oped in the three part series of papers had never been tested in a specific 
local situation. Therefore, the Michigan Department of Education proposed to 
the Cooperative Accountability Project that a limited test of the model be 
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made during the period January 1974 to March 30, 197if. This limited test 
was to be aimed at Investigating the reactions of participants at the local 
level to attempts to train them to disseminate elements of the model developed 
by Bettinghaus and Miller* 

This pilot training project is essentially complete. The only task yet 
remaining is to develop two training monographs which were identified as being 
potentially useful by the consultants. These monographs should be completed 
prior to April 30, 197if. 

This Final Report contains (1) A brief statement of the project's accom- 
plishments, (2) An evaluation of the project prepared by the project evaluator. 
Dr. Fisher, (3) A budget analysis, (4) recommendations for future efforts in 
this area, and (5) an appendix containing the materials produced for the pro- 
ject. No attempt will be made to review the PERT Chart for the project, since 
that task was completed in the two interim reports, 

PROJECT ACCOMPLISHMENTS 
The dissemination model produced by Dr. Bettinghaus and Dr- Miller during 
1973 was based on the identification of specific target audiences, and attempt^ 
to communicate with those audiences in ways which might appeal uniquely to 
them. The various elements of the dissemination model, while generally appli- 
capable to the problems of dissemination of materials about educational 
accountability, had not been tested within a local school district setting. 
Thus the purpose of this project was to select a school district in Michigan, 
acquaint them with the principles of the dissemination model, and attempt to 
have them do some work with a selected target audience. No funds were pro- 
vided to the local school district to assist them in this enterprise. 
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Following preliminary planning meetings (described in interim reports), 
the Gull Lake Michigan School District was selected. The district is semi- 
rural in nature, located within a few miles of Kalamazoo, Michigan, but having 
little indusvi^y, and no media serving the district directly. Its character- 
istics are much like thousands of districts across the country which are not 
located in the midst of a large city, but offer a K-12 range of education. 

The Superintendent of the district was interested in dissemination of 
information about Michigan Assessment, particularly because he felt that 
many teachers and School Board members had an inadequate understanding of 
Michigan Assessment. The Superintendent expressed some interest in dissemin- 
ating information to audiences of parents and taxpayers, but could not be 
convinced to make such attempts within the time frame covered by this pilot 
project. Therefore, dissemination efforts were confined to audiences of 
teachers and school board members. 

The main effort of this pilot project was spent in developing and con- 
ducting three training sessions, and then holding a fourth training session 
where final questions could be answered, the results of the training could 
be assessed, and reinforcement of any concepts could be accomplished. As 
was described in the project logs appended to the interim reports, the pro- 
ject attempted to give each participant information and training in three 
areas: (1) A working knowledge of the dissemination system, (2) further 
essential information about Educational Accountability, with specific atten- 
tion to the Michigan Assessment Data generated for that district, and (3) a 
working knowledge of evaluation techniques designed to help the participants 
in evaluating the results of their communication activities. These three 
objectives are described in more detail below: 
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Tralning for Dissemination 

The dissemination model produced in the earlier CAP monograph stresses a 
number of elements deemed inappropriate to the Gull Lake School District Ad- 
ministrators. For example, the complete dissemination model stresses the use 
of the mass media to reach large numbers of parents and citizens. The Gull 
Lake superintendent did not wish to stress this aspect of the dissemination 
model at the present time. Therefore, this material was largely eliminated 
from the training sessions. Instead^ the concentration was on training in 
those aspects of the dissemination model which stress interpersonal communica- 
tion. 

The major areas of information stressed in the communication training 
during the sessions included: (1) formulation of the conanunication objective, 
(2) determination of the communication setting, (3) identifying potential 
barriers to communication, (4) identifying potential audiences for communica- 
tion, and (5) preparing dissemination messages. 

During the first training session, it was discovered that a number of 
participants had difficulty in formulating communication objectives. There- 
fore, a "check-list" of steps necessary to successfully develop a communica- 
tion objective was prepared, together with a work sheet. Although these 
materials are clearly not sufficient, they did seem to be of he\p to the 
participants as they attempted to formulate objectives for particular 
audiences. Appendix A contains an example of the "check-list" as well as a 
work sheet. Appendix B contains the work sheets as they were prepared by 
the participants. 
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Training in Accountability 

Early in the training sessions, the consultants discovered that many of 
the participants were inadequately trained in elements of the Michigan Account- 
ability Model, specifically Michigan Assessment Test data for their school and 
district. Although all participants had been exposed to some of the materials 
available from the Michigan Department of Education, they did not have some of 
the specific information about the most recent Michigan Assessment Test which 
would enable them to communicate accurately to others. Therefore, a portion 
of the second training session was devoted to training the participants in 
specific aspects of Michigan Assessment insults as they applied to the Gull 
Lake District, 

The major areas of information stressed in the portion of the second 
session devoted to Michigan Assessment included: (1) interpretation of the 
report forms generated by the Michigan Educational Assessment Program, 
(2) description of the relationship between the HEAP tests and the state's 
minimal objectives, (3) information on the relationship between HEAP test 
data and possible utilization of the data by local districts. 

The success of this portion of the second training session was tested in 
two ways. First, specific questions relating to Michigan Assessment were 
asked in a written evaluation section following the final session (see evalu- 
ation section). Second, judgments were made as the result of viewing the 
materials each participant prepared for the audiences they were working with. 
The materials prepared were in the form of charts and graphs designed for use 
with the particular audiences the participant needed to communicate with* 
Unfortunately, the materials prepared were of such a size that it was impos- 
sible to reproduce them for inclusion in this report, 
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Training in Evaluation 

One of the real problems in training individuals to be able to engage in 
dissemination activities is to give them information which will let them eval- 
uate their own activities. The consultants decided to devote a portion of the 
second training session to training for evaluation. Although the consultants 
felt that more material on evaluation activities would have been helpful, the 
session was still deemed a success by the participants. 

The major areas of information stressed in this portion of the second 
training session included: (1) a description of the relationship of evalua- 
tion to communication activities, (2) types of evaluation available for use 
in communication situations, and (3) components of the evaluation process. 

As a result of experiences working with the evaluation component, the 
consultants decided that it would be helpful to have a short monograph on 
evaluation activities in similar situations. This has been proposed to CAP, 

In brief form, therefore, the training sessions: 

1, Gave the participants information about comm\inication and the dis- 
semination model, 

2, Gave the participants further information about the Michigan Educa- 
tional Assessment Program, 

3, Gave the participants information about evaluation of communication 
activities. 

PROJECT EVALUATION 

Design of Evaluation 

The original project proposal from the HDE to CAP was not complex and 
was heavily oriented toward a "process" type of evaluation as opposed to a 
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'•product^' type. Therefore, the proposal asked for certain checks to ascertain 
that progress was being made and that the project maintained its time schedule. 

After beginning the project, this sketchy design was made somewhat more 
stringent— particularly in the area of specific things the consultants wanted 
to accomplish. The fo.lloi^ing data were, therefore, collected: 

1) Process logs for each of the four training sessions and 
for one pre -project meeting in Gull Lake and for one 
planning session between Drs. Bettinghaus and Fisher; 

2) Participant feedback forms completed after the first 
and second workshop sessions; (See Appendix C) 

3) Participant feedback information collected after com- 
pletion of the project; (See Appendix D) 

If) A participant questionnaire or "test'* of certain 
salient communication topics; (See Appendix D) 

5) A participant questionnaire or "test" of certain 
skills related to the Michigan Educational Assessment 
Program; (See Appendix D) 

6) Copies of participants' worksheets on communication 
objectives; and 

7) Copies of the charts, graphs, etc< produced by some 

of the participants as they worked on their communica- 
tion objectives. 

Each process log was sent to CAP in the two interim evaluation reports* 
The other items have been included herein as APPENDIX items. The final two 
participant questionnaires were scored and are reported in the following 
section » 
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Analysis of Results 

Each process log summarized the difficulties and successes of each of 
the four training sessions. Since these items were attached to the interim 
reports they will not be repeated here but will only be summarized. 

1. The project staff met with some initial confusion when 
the participants did not understand the objectives of 
the project. This was overcome by the third meeting. 

2. The project staff was unable to convince the local 
superintendent to attempt to compose and work on any 
dissemination steps with audiences other than the 
school board and teacht^rs. 

3. Some of the participants were not as well motivated 
as were others. 

^. The consultants were too pressed for time and were 
not able to prepare all of the needed teaching aids 
which weine needed. 

5. The project staff did manage to interest the parti- 
cipants in thinking seriously about dissemination 
activities, but it is not known if this interest 
level will be sustained. 

6. Most participants were not completely familiar with 
Michigan Assessment, and project staff had to spend 
more time than planned in achieving familiarity 
with Michigan Assessment. 

7. The participants did indicate throughout the project 
that the consultants were doing an acceptable job of 
presenting the material. 
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8. The final open-ended survey (process-type) completed 
by the participants indicated that 1) the experience 
of the project had been worthwhile but 2) there was 
still sotne apprehension about their understanding of 
dissemination systems. (This is understandable since 
there really was only time enough during the four 
sessions to acquaint them with the theories,) 
The two or three participants who attempted to design Audio-Visual aids 
for use in dissemination activities with the board and with selected teachers 
produced worthwhile efforts* However, the materials were somewhat crude and 
unpolished. This may be due to a lack of time to work on them, a lack of 
skill, a lack of materials, or a lack of interest ♦ One might well assume 
that such efforts will be crude unle^ss there is sufficient training and 
assistance for the communicator — in this case LEA administrators. During the 
next grant CAP period, the consultants will have to critically assess LEA 
capabilities in this regard. 

Also included in Appendix C of this final report are the worksheets used 
by the participants to construct their communication objectives. As was men- 
tioned in the Process Log for February 20, 1971, these objectives are not of 
particularly high quality. They reflect confusion on how to write such ob- 
jectives in a clear and concise manner. This problem is probably related to 
the lack of sufficient time to teach such skills and to the lack of adequate 
training materials. Hopefully, the latter problem will be solved by the 
planned development of a brief monograph on the topic. 

The final evaluation survey consisted of two different forms. The first 
form (see Appendix D) was composed of seven questions devoted to communication 
O 
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theory and applications. It was designed to help determine if the project 
participants had learned certain major concepts essential to the dissemina- 
tion model. The second form consisted of ten questions directly related to 
the data resulting from the 1973-7^1 Michigan Educational Assessment Program, 

The questions on each form were scored by the project evaluator. In the 
case of the first form, the seven questions were scored on a 5 point scale. 
The scoring decisions were subjective and depend solely on the evaluator's 
judgement. The second survey was scored on a simple "right -wrong" basis and 
was not as subjective • 

Distributions of the results of the survey on communication are shown 
in TABLE 1. 



TABLE 1 

DISTRIBUTION OF SCORES ON COMMUNICATION SURVEY 



Question 


Scores 


5 1 1+ 


3 


2 


1 




■ 










1 


0 


1 


2 


3 


3 


2 


1 


3 


3 


2 


0 


3 


5 


2 


0 


0 


1 




9 


0 


0 


0 


0 


5 


2 


7 


0 


0 


0 


6 


9 


0 


0 


0 


0 


7 


0 


3 


6 


0 


0 



In viewing these data» it is clear that the lowest scores were obtained 
on questions 1, 2, and 7. These questions dealt with an understanding of 
communication objectives, interpersonal cwnmunication channels, and communi- 
cation evaluation. The lowest scores were obtained on the first of the three. 
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This tends to conflrni the consultants' feelings about their success in explain 
ing coiranunication objectives as was noted in an earlier Process Log. It also 
supports the need for additional teaching materials devoted to this topic* 
Scoring of the second survey (on the Michigan Educational Assessment 
Program) resulted in seven people getting 100% of the questions right and two 
people getting 90% right. While this survey by no means exhausts the topic, 
it tends to confirm the consultants previous view that the participants were 
able to understand certain basic information being generated by the assessment 
program. 

Suiwnary 

In summary, this project attempted to conduct a small, pilot training 
project in elements of the dissemination system developed during the previous 
CAP funding period. Success, then, depended upon elements of the training 
process and not upon the results of the dissemination efforts of the LEA par- 
ticipants. 

With this in mind, the project seems to have been successful to a degree 
but not as successful as was originally desired. The chief reason for this 
was a lack of time to develop all of the necessary materials when they were 
needed most and a lack of teaching time to reinforce the participants* under- 
standings and skills. 
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BUDGET ANALYSIS 



The budget for this project was satisfactory. Of the allocated funds to 
the primary contractor, Dr. Bettinghaus, a total of $1105.00 was spent to com- 
plete the training phase and to complete the required reports. An additional 
total of $520.00 will be needed for preparation of the two proposed monographs. 
Thus, $375.00 will be returned to the contractor from the initial budget of 
$2000.00. The expenditures are less than the original projected figures 
Because it was not found desirable to produce the elaborate training materials 
originally called for in the proposal. 

A complete breakdown of expenses is shown below, divided by the two major 
project tasks: 

Budget: Training 

Dr. E.P. Bettinghaus: 



Initial Planning sessions (2 half days) 
Develop objectives, lesson plans 
Conduct Sessions half days) 
Interim reports 
Final Report D 



1.0 dy 
1.0 dy 
2.0 dys 
.5 dy 
2.5 dys 



Total 



7 dys 



700.00 



Dr. R. Roth: 



Needs analysis; planning 

Develop Objectives 

Conduct Sessions (4 half days) 



• 5 dy 
.5 dy 
2.0 dys 



Total 



3.0 dys 



300.00 



Other Expenses : 



Secretarial 

Final Report: Materials, binding, mailing 



3 dys 



60.00 
45.00 



Total 



$1105.00 
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Budget: Monograph 



Dv. E.P. Bettinghaus: 



Monograph on Communication Objectives 
Editing monograph on Evaluation 



2,0 dys 
. 5 dy 



Total 2,5 dys 



250,00 



Dr, R. Roth: 

Monographs on Evaluation 



2,0 dys 200.00 



Other: 



Secretarial 
Monograph Production; 



2.0 dys 



MO. 00 
30.00 



Total 6.5 dys $520.00 
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GRAND TOTAL 



$1625.00 



RECOMMENDATIONS FOR FUTURE ACTIVITIES 



Several suggestions for change in our procedures appear in the interim 
reports filed earlier in the contract period. The evaluation section completed 
by Dr, Fisher also points to areas in which the training could be improved. 
This section will not specifically review each of those earlier recommenda- 
tions. Rather, we shall concentrate on a series of general recommendations 
which might be used to improve further training efforts aimed at transmitting 
the dissemination model to local educational personnel. 

1. Future training efforts must involve more total time in the training 
effort . This project involved four half days of actual contact with the par- 
ticipants. Of that time, only two half days actually involved the specific 
transference of new knowledge. The remainder of the time was taken up with 
evaluation efforts, practice in writing and reviewing communication objectives, 
and answering questions. It is not unreasonable to suggest that at least two 
full days are needed for training in the dissemination area alone, with addi- 
tional time needed for evaluation efforts, 

2. Future training efforts must begin from a solid base of knowledge 
about educational accountability , The goal of dissemination training is to 

be able to have local school district personnel competent to communicate about 
educational accountability with various types of audiences. A first require- 
ment is that the school district personnel selected as communicators be 
thoroughly familiar with all elements of the accountability model to be used. 
As we have pointed before, the Gull Lake personnel had had some exposure to 
Michigan Assessment, but they were not thoroughly familiar with the details 
of Michigan Assessment, nor how the data for their school could be used to 
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assess the adequacy of certain aspects of the curriculum. Thus, future efforts 
at teaching communication about accountability should begin with efforts to 
teach the accountability model itself to those who will be responsible for 
disseminatioii. 

3. Special attention must be given to the preparation of communication 
objectives . The participants in this project had significant difficulties in 
preparing clear, concise, communication objectives. To the extent that com- 
munication objectives form the heart of any system of instruction about dis- 
semination, this step should be emphasized, utilizing all appropriate visual 
aids and practice sessions. 

4/ Some care mu s t be taken to insure that each communicator within a 
district communicate the same ^'position" about accoxintability . In this pilot 
project, the participants included the superintendent, the director of curric- 
ulum, and the principals of each school in the system. Although there cer- 
tainly will be very legitimate differences between what a high school principal 
communicates to his teachers, and what an elementary principal communicates to 
his, there should be close agreement on the attitudes that need to be communi- 
cated, and on the details to be communicated at each level. With this project, 
it was noted that different principals tended to communicate differently, and 
no efforts were made to insure any uniform communication tasks. 

5. Funds need to be provided directly to the district to enable local 
school personnel to develop materials for use with various audiences . Most 
of the participants in the pilot study did an excellent job of attempting to 
coimunicate to their selected audience. Their task was made, more difficult, 
however, because they Jid not have the opportunity to construct visual aids, 
nor to make use of any mass media techniques. While some of the participants 



ERIC 



-16- 



did try to raake visuals, th<^ lack of funds meant that only crude materials 
were constructed, 

6 . ruture training efforts must involve districts that need to communi' ^ 
cate to the general public . The original dissemination model developed by 
Bettinghaus and Miller involved communication to a number of potential audi- 
ences central to the school district personnel, i»e,, teachers and school 
board members. To provide a complete test of the dissemination model will 
require efforts within a local district that is interested in providing 
information about educational accountability to audiences of parents and the 
general tax-paying public as well as audiences closely associated with the 
school system. 
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APPENDIX A 

Communication Objective Check-List 
and 
Work Sheet 
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Disseminating Information About Educational Accountability 

Formulating the Communication Objective 

Clearly, one of the most important steps in disseminating information about 
assessment or accoxmtability is the formulation of a clear communication 
objective or set of objectives. Below, we list a number of questions which 
any communicator ought to ask before he prepares a message. 

Step !• Selecting and Defining a Target Audience 

A* Exactly what audience is to be the target of attention? 

1. The School Board? 

2. The Teaching Staff? 

3. Parents? 

a* Of fourth and seventh grade children? 

Of children in other grades? 
The voting public? 
B, What is the probable size of the audience? 
C* What do we know about the probable knowledge level of the 

audience members? 
D- What do we know about the probable attitudes of the 
audience? 

1. Toward assessment? 

2. Toward accountability? 

3. Towaid the school system? 

4. Toward the communicator? 

Step II, Determining the Desired Outcome of Communication 

A- What do we want our audience to know about accountability? 
B- What attitudes do we want our audience to possess? 

1. Toward accountability? 

2. Toward the school district? 

3. Toward the communicator? 

€• Are there any specific actions we want our audience members 
to take? 

1» Inform others? 

2» Support school bond issues? 

3. Other possible actions? 

Step III, Selecting the Communication Setting 

A. Will we meet our audience in an interpersonal setting? 

1. In school? 

2. With others present? 

B. Will ^.'e meet our audience in a group setting? 

C. Will we have to make use of mass media? 

1. Letters, posters, charts, etc.? 

2. Radio, television, newspapers? 
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WORK SHEET 



Below are provided spaces for determining exactly what communication objec* 
tives you are interested in* After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet. Utilize a single sheet for each 
audience. After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience* 



A. Nature of the Audience 



B. Desired Outcomes 



C. The Communication Setting 



D. The Communication Objective 
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APPENDIX B 

Communication Objectives - Work Sheets 
Prepared by Gull Lake Participants 



Richland Elementary School 

WORK SHEET 



Below are provided spaces for deterfrtining exactly what communication objec- 
tives you are interested in. After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet. Utilize a single sheet for each 
audience. After answering each of the questions, the final space should 
allow you to write a short > relatively specific communication objective for 
that audience* 

A. Nature of the Audience 

Building Staff - Kdg. thru 3 
15 people 

Limited knowledge of assessment and accountability 

Skeptical and perhaps frightened of assessment and accountability 

Good attitude toward system and communicator 



B, Desired Outcomes 

Know results of this year's Fourth Grade assessment test scores so 
that an attitude of understand can be developed rather than one of 
fear and perhaps "hate/' Understand coiWBunicator is ready to move 
in developing a positive understanding/ 



C, The Communication Setting 

Informal gathering of group involved. 



D. The Cownunication Objective 

Realization that results can be useful to use as a staff (team) in 
adapting our approach to the teaching of Mathematics and Reading, 
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Richland Elementary School 

WORK SHEET 



Below are providad spaces for determining exactly what coinmuni cat ion objec- 
tives you are interested in ; After attempting to answer each of the questions 
on the prior sheet\ turn to a work sheet. Utilize a single sheet for each 
audience* After answering each of the questions, the final space should 
allow you to write a shorty relatively specific conmunication objective for 
that audience/ 

A. Nature of the Audience 

Building Staff - Kdg. -3 
15 people 

Increased knowledge of assessment and accountability 

Better understanding (hopefully) of assessment and accoimtability 

Good attitude toward school system and communicator 



B, Desired Outcomes 

Realize we are teaching "skills^' that are included on the Reading 
section of assessment test, however, they may differ in substance. 
Know that communicator will make available materials to determine 
our skills. 



The Communication Setting 
Informal meeting of staff 



D» The Communication Objective 

Compare and evaluate our skills with those on assessment test and 
start ^'plugging in" supportive skills where we differ in content 
of skill. 
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Mildermuth Eleinentary School 

WORK SHEET 



Below are provided spaces for determining exactly what commixnication objec- 
tives you are interested in; After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet. Utilize a single sheet for each 
audience • After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience • 

A. Nature of the Audience 

Kindergarten through 3rd Grade teachers and reading support 
teacher* 



B. Desired Outcomes 

To foster positive attitudes for the assessment program. 
To reduce apprehensions. 

To develop high interest to become knowledgeable in interpreta- 
tion of the results from the October, 1974 assessment testing. 



The Communicating Setting 

Informal round-table gathering* 



D. The Communication Objective 

Given available testing data and an opportunity to orally review 
the recently shoi«m film, the teachers will become less apprehen* 
sive, will be able to answer specific questions concerning the 
test results, and will desire to investigate and to discuss fur- 
ther individual J building, district and state results and our 
reading and math goals, 
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Wildermuth Elementary School 

WORK SHEET 

Below are provided spaces for determining exactly what communication objec- 
tives you are interested in. After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet ♦ Utilize a single sheet for each 
audience. After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience* 

A. Nature of the Audience v 

1-3 teachers meeting individually with principal* 



Desired Outcomes 

To be able to use the terniinology. 

To have confidence in interpreting testing results. 

To develop a goal for further study, comparing, and evaluating 

assessment tests, standardized tests with regard to our present 

programs. 



C, The Communication Setting 

Round table informal discussion and study. 



D* The Communication Objective 

Given available data and an opportunity to study and evaluate 
results, the teacher of thirds second, and first grades will 
become more comfortable to discuss and interpret testing pro- 
grams and will develop a goal to study the assessment results, 
standardized testing achievements, and our district reading and 
math objectives particularly for her level. 
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WORK SHEET 



Kellogg Elementary 



Below are pty>vided spaces for determining exactly what cormiunication objec- 
tives you are interested in* After attempting to answer each of the questions 
on the prior sheet , turn to a work sheet. Utilize a single sheet for each 
audience r After answering each of the quest ions , t he final space should 
allow you to write a short / relatively specific communication objective for 
that audience, 

A* Nature of the Audience 

Three Kellogg Uth grade teachers with principal and Curriculum 
Consioltant 



B. Desired Outcomes 

To impart knowledge of '73 State Assessment Tests 
To give results of Kellogg tests 

To compare Kellogg tests to the building composite, Gull Lake composite 
and State results 

To recognize areas of strength and weakness in class and individual 
reports 

To plan program and teaching strategies to better meet goals 
To give opportunity to answer staff questions re educational 
assessment 

C. The Coirmunication Setting 

Interpersonal with three Ith grade teachers 

Two meetings with an evaluation meeting at the end of the year 



D, The Communication Objective 

By the end of the first session, after viewing the State Dept. of 
Education film, the teachers will better understand the reporting of 
the results of the new objective referenced tests given to the 4th 
graders in Oct. 1973. 

Using the information provided b/ the Test Dept. the teachers will 
use the Information from the class summary, Individual records and 
building summary to see the strengths and weaknesses of Kellogg 
children in general and individual children in particular. 

By discussion, followed by a two to four part questionnaire, to 
determine if teachers understand objectives of meeting and how to 
O interpret objective referenced tests, score details, objective 
ERJC code, work relationships, classroom listing report, etc. 



WORK SHEET 



Kellogg Elementary 



Below are provided spaces for determining exactly what communication objec- 
tives you are interested in. After attempting to answer each of the questions 
on the prior sheet, tun) to a work sheet* Utilize a single sheet for each 

A. Nature of the Audience 

Three Hth grade teachers (continued) 



B. Desired Outcomes 



C. The Communication Setting 



D, The Communication Objective 

By the second meeting the teachers will go over their assessment tests 
and based on these bring a needs assessment of their individual children 
and class based on the State Assessment test and Stanford Achievement 
scores In Math and Reading. 

At this same meeting to share info on teaching strategies and materials 
to better meet the needs assessment of the 4th grade pupils in our 
building* 

To set up suggested behavioral changes and performance gains for 
teachers and pupils for balance of year with an evaluation by each 
teacher at the end of the year plus testing as to whether or not 
these objectives are met partially » mostly or completely* 
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WORK SHEET 



Kellogg Elenientary 



Below are provided spaces for determining exactly what communication objec- 
tives you are interested in. After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet* Utilize a single sheet for each 
audience/ After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience. 



A, Nature of the Audience 

18 Kellogg clojsroom teachers plus supporting staff (Speech, reading, 
resource, art, music, p*e., student teachers) with principal 



B. Desired Outcomes 

To increase understanding of the 1973 Assessnient Tests 
To give the Kellogg results with interpretation to increase knowledge 
To help teachers recognize the areas of strength and weakness in 
meeting minimal state objectives 

To give staff chance to ask questions to cle?ir up apprehension about 
assessment (accountability) 

To review building objectives and teaching strategies to improve 
performance in future 

C, The Communication Setting 

Face to face with total staff — Principal and 4th grade teachers 



D. The Communication Objective 

To introduce entire staff to new objective referenced test by showing 
State Dept. film on 1973 assessment 

To provide staff with information on the Kellogg summary of 4th grade 
test results for Oct. 1974. 

To provide a 2-U part evaluation sheet at end of the session which 
will assess if above objectives were met and understood by teachers. 
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Kellogg Elementary 

WORK SHEET 



Below are provided spaces for determining exactly what communication oble'c^ 
tlves you are interested in. After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet. Utilize a single sh^et for each 
audience. After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience* 

A. Nature of the Audience 

Classroom teachers and supportive staff (continued) 



B. Desired Outcomes 



The Coirmunioation Setting 



Dt The Communication Objective 

To set up some behavioral changes and performance objectives to improve 
education in reading and math in K-3 in a follow up meeting within a 
month • These will be evaluated later in the year, with a follow-up 
after fall testing. 
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Kellogg Elementary 



WORK SHEET 



Below are provided spaces for determining exactly what communication objec- 
tive you are interested in. After attempting to answer each of the questions 
on the prior sheet i turn to a work sheet • Utilise a single sheet for ^ach 
audience/ After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience « 

A. Mature of the Audience 

Kellogg P.T.A, parents with special invitation to Uth grade parents 
and teachers 



B. Desired Outcomes 

To help the parents understand the 1973 State Assessment testing 
To encourage patents to have a supportive role toward the assessment 
program 

To give opportunity for questions and discussion so people go home 
with a better understanding and interest 



C. The Communication Setting 

Face to Face with probably 50 parents/teachers 



The Communication Objective 

To inform the parents of the make-up of the Michigan Assessment Test 
and how the scores are reported to the school* 

To help the parents understand the results of the Kellogg and Gull 
Lake tests and what staff is doing to determine needs « 

(Discussion and questions will provide feedback as to product of 
meeting.) 



Gull Lake Intermediate School 

WORK SHEET 



Below are provided spaces for determining exactly what communication objec- 
tives you are interested in* After atteinptlng to answer each of the (Questions 
on the prior sheet; turh to a work sheet • Utilisse a single sheet for each 
audience • After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience, 

A. Nature of the Audience 

4th Grade Teachers at Gull Lake Intermediate School, 



B, Desired Outcomes 

To assess the objectives each child did not get correct on the 
Michigan Assessment Test, 



C. The Coitmunication Setting 
Small group setting. 



0. The Communication Objective 

Given the results of the Michigan Assessment Test, the teachers 
will identify the objectives each child received incorrect and 
to develop program to help these students. 
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Bedford Elementary School 

WORK SHEET 



Below are provided spaces for determining exactly what corranuni cation objec- 
tives you are interested in. After attempting to answer each of the questions 
on the prior sheet, turn to a work sheet. Utilize a single sheet for each 
audience. After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience. 

A, Nature of the Audience 

Professional Staff, classroom teachers and specials. 



B. Desired Outcomes 

Communication to parents on assessment results by staff toward a 
favorable attitude and understanding of test objectives. 



C. The Communication Setting 

Staff meeting in school 3:10 



D. The Conraunication Objective 



Staff to be able to communicate information on assessment tests to 
parents via parent teacher conferences. 
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Middle School 



COHMUNICATION OBJECTIVES 
Middle School 



1. To Tnake Staff knowledgeable of state assessment test results as indicated 
by correct verbal response to pertinent questions about specific parts of 
the test summaries. 



2. To enable teachers to evaluate and interpret test results as indicated by 
teachers correctly interpreting specific items and suggesting ways of 
implementing classroom instructional techniques. 



3. To train teachers to communicate test results to interested parents as 
indicated by teachers giving verbal demonstrations to indicate their 
ability to do so. 



To train teachers to make use of the test items to evaluate and improve 
their pi?ograms as indicated by questioning teachers one month after the 
presentation to determine how much use was made of the assessment test 
results. 
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Gull Lake High School 

WORK SHEET 



Below are provided spaces for determining exactly what communication objec- 
tives you are interested in. After attempting to answer each of the questions 

sheet ,^ to a work^ sheet . Utilize a single sheet fbr each 
audience. After answering each of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience* 



A» Nature of the Audience 



B. Desired Outcomes 



C. The Communication Setting 



!)• The Comnunication Objective 

Given a presentation on the Michigan Assessment Program, the high 
school staff will better understand the program as observed by the 
high school principal. 
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Board of Education 



WORK SHEET 



Below are provided spaces for determining exactly what conmiunication objec- 
^^^^^ y^^^^^ ^^^^ i"* After attempting to answer each of the questions 

on the prior sheet, turn to a work sheet. Utilize a single sheet for each 
audience. After answering each of the questions » the final space should 
allow you to write a short, relatively specific communication objective for 
that audience. 



A. Nature of the Audience 

Seven man Board of Education 



B* Desired Outcomes 

The Board of Education will be able to take a position on what we 
should be expecting from Michigan Assessment. 



C. The Communication Setting 

A small group setting at the Administration Building* 



D, The Communication Objective ^ . _ 

Given information on our results of the Michigan Assessment Test, 
the Board of Education will be able to tal<e a position on what 
results the Gull Lake Schools should expect from the Michigan 
Assessment Test in the future. 



Board of Education 

WORK SHEET 



Below are provided spaces for determining exactly what communication objec- 
tives you are Interested in. After attempting to answer each of the questions 
on the prior sheet , turn to a work sh^et. Utilize a single sheet for mh 
audience. After answering each, of the questions, the final space should 
allow you to write a short, relatively specific communication objective for 
that audience. 



A. Nature of the Audience 

Seven man Board of Education 



B. Desired Outcomes^ 

To know if the assessment test assesses what is actually taught 
in our present curriculum* 



C. The Communication Setting 

A small group setting at the Administration Building, 



D» The Communication Objective 

Given information of our curriculum along with the objectives tested 
on the Michigan Assessment test, the Board of Education will be able 
to determine whether our curriculum stressed the objectives on the 
assessment test. 
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APPENDIX C 
Participant Feedback Forms 



Date : 



WORKSHOP FEEDBACK FORM 

(2nd Training Session) 
Please complete this brief feedback form before you leave the meeting today. 
Be as candid as possible in your remarks. Do not sign your name to this form, 

!• As you understand them, what were the objectives of today's seminar? 



2, To what degree did you find today's discussion of the Michigan Educational 
Assessment Program to be of worth to you? 



5 ^ 3 2 1 

Very Of Little 

Worthwhile Worth 



$• To what degree did you find today's discussion of the evaluation of the 
effectiveness of communication to be of worth to you? 



5 4 3 2 1 

Very of Little 

Worthwhile Worth 



4* Do you feel the speakers did an acceptable job of presenting the material 
in today *s seminar? 

a) Yes b) So-So c) No 



Si In the space below, please describe what you understand to be your ^'assign- 
ment^^ for the next session. 



6» On the reverse side, please make any other coTranients you wish to make about 
the direction of the total project or today's session. 
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Dat^t 



WORKSHOP FEEDBACK FORM 
(1st Training Session) 

Please complete this brief feedback form before you leave the meeting today. 
Be as candid as possible in your remarks. Do not sign your name to this form. 



!• As you understand them » what are the goals of this cooperative project 
between the Michigan Department of Education and the Gull Lake Community 
Schools? 



2. As you understand them, what were the objectives of today's seminar? 



3* What is your overall impression of the potential worth of this project 
to your school operations? 

5 ZT 5 T" 1 
Great' Potential Little Potential 

Worth Worth 



to what degree did you find today's seminar to be of worth to you? 

^-/r- ■■■■■■-^^^ 5 1 3 i 1 

Very Of Little 

Worthwhile Worth 

5> Do you feel the speakers did an acceptable job of presenting the material 
in today's seminar? 

a) Yes b) So-So c) No 



6. On the reverse side, please make any other corwnents you wish to make about 
the total project or today's session. Your constructive suggestions would 
be appreciated* 
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APPENDIX D 



Participant feedback information collected at end of Project 
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Date: 



GULL LAKE PROJECT FINAL EVALUATION FORM 

Please complete this form anonymously and return to Bob Schinderle. 

1. In your own words, define a "communication objective" and its usefulness to 
you* 



2, What are some advantages and disadvantages of small group discussions vs a 
written report or newsletter in communicating Gull Lake's assessment results 
to parents? 



3. What are some typical communication barriers which may occur as you attempt 
to relate assessment results to your board of education? 



Name four audiences for which a Gull Lake elementary principal should pre- 
pare distinctly different corranunication objectives and procedures to 
relate infomnation about the state assessment program* 



5. Why is it important to evaluate communication efforts? 



6. What might be a good way for an elementary principal to evaluate whether 
or not his 4th grade teachers understand the assessment report forma? 



Assume that the superintendent intends to make a presentation to a PTA 
meeting on state assessment results for Gull Lake. How might he evaluate 
his presentation? 
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GULL LAKE PROJECT FINAL EVALUATION FORM 
Please complete this form anonymously and return to Bob Schinderle. 

1. For Able Eletftentary School (Uth grade) what percentage of pupils attained 
math objectives AR-I-.B-45? * 

2. For Able Elementary School (Uth grade) what is the «»short title** of math 
objective number 25? 



3- For Able Elementary School (4th grade) what percentage of students got 3 
answers correct on math objective number 18? 



4. For Able Elementary School (4th grade), how many students took the math 
test? 



• For student John Roberts, was math question 120 correct or wrong? 



?• For student Oohn Roberts, how many questions for math objective 12 were 
answered correctly? ' ^ 



8. What symbol is used on the student report form for an omitted question? 



9. What answer "Foil" did John Roberts select for reading question number 200? 



Ipi In the Word Relationship's test, John Roberts scored higher than what 
percentage of Michigan students? 
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FIGURE 1: THE INDIVIDUAL STUDENT REPORT FORM 



ii 



CD 



8 



z 


^ o 




» < 


ft «» 




o 




z 


;S o 


s» a 


« 4 


& CD 








z 


Si 




So 






o 


z 


? 4 


^ X 




S < 


§ 4 






>• 


E + 


FT 


s t 


5 4 


? 4 






z 


2? CO 




«< 


£ It. 


So 


O 




z 


S a> 




^ M 


S o 




P 




>- 


S 4 


R u. 


B 4 


A 4 


« 4 




z 




u. 


»o 


ft 


» 4 








S + 


2 + 


2 4 


3 4 


^ 4 






z 


^ ♦ 




• CO 


r 


So 






>- 


J 4 


5 * 


2 4 


5 4 


S 4 


1/^ 


z 






« X 


^ « 


« >> 


O 


V, 


z 


s o 


» o 


R < 




« < 


o 


>• 




^4 


5> 


^ 4 


S 4 




>- 


i$ 4 


fc 4 


ft 4 


It O 


a 4 




>- 


4 


« 4 


» 4 


X 4 


ft 4 


UN 


>- 


* 4 


> 4 


^ to 


« 4 


R 4 




2 




9 < 




4 4 




1-4 


y 


« > 


&: 4 


8 4 


1 4 


Id 4 


WS 


z 


S 4 


S o 


go 


5 4 


5 ♦ 


fA 


>. 


,^ 4 


^ 4 


^3 4 


^ + 


^4 






O 








6 D 


0 




z 


si u 


8 ± 


e< 




§u 


O. 




2 


< 4 




91 4 


ft r 


$ O 


<^ 


z 


6 




C O 


Si 




o 




4 


4 


4 


ft 4 


9 4 




z 


2 4 


Si 


3 o 


? ^ 






> 


5 4 


S ♦ 




5 + 


8 4 




z 




& < 




^ ^< 






z 


5 o 


§^ 


§ < 


i X 




o 


>- 




5 + 


§4 


1 4 


2 4 


lA 






5 + 


? + 


5 ♦ 


S 4 






y 4 


^ 4 


e o 








>- 








ft + 


8 4 





HI 

§1 



CO o 




X 



I 

i 




BEST COfY AVAILABLE 



FIGURE 1: THE SCHOOL SUMMARY FORM 
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OPEN-ENDED EVALUATION QUESTIONS 
(Final Project Evaluation) 



In yoxxv opinion, has this experience been worthwhile? 

a) Yes, it has helped me understand the material better. It has made me 
dig for information. 

b) Very much so, I think the project brought the principals together to 
work on a problem. The project helped to identify areas that may have 
given us problems in coiranuni cat ions and to work directly with them. 

c) Yes, it has given me personally a broader understanding of the assess- 
ment program. Some questions or doubts have been answered or cleared 
up. It has given me a more positive attitude toward the whole idea. 

d) Yes, because it built up my confidence in my ability to commxinicate 
information to my staff, and to have a basis for that information. 

e) Yes, as the neetings have beeter equipped me to communicate more 
clearly and hopefully more effectively with my staff. I feel the 
same would be true with parents. 

f) I feel this experience has been worthwhile since it forced us to take 
a look at the assessment test results in a different way than we might 
have done. I think it has given us a more positive attitude toward 
the assessment test. 

g) This instructional experience has been very worthwhile for me from the 
standpoint that it has made me much more aware of the various aspects 
of group communication. It also has made me more knowledgeable of the 
state assessment test and its various uses as well as weaknesses. It 
has made me get back to the staff with emphasis on utilization of the 
test infonnat ion. 

h) Yesl I eagerly found the time (as I was genuinely interested in all 
facets and knowledge I could obtain from the results) to seek out infot** 
mation to present facts and knowledge of the results to the various 
groups --.K-3 teachers, tfth grade parents as some usually attend the boar»d 
meetings * Through out meetings I was able to more quickly and in a more 
knowledgeable way find and Interpret the information. 

i) Yes, because: 

a) I feel I am more knowledgeable. 

b) ^I feel I can help my teachers better understand and use the results, 
o) We did a better job on our homework. 

d) Enjoyed the sharing with other principals and consultants, (with 
Central Office personnel back-up 

e) Hope will improve instruction in our building with some total involve- 
ment, some grade involvement, and some individual teachers needing 
help. 



Evaluation Questions 
Page 2 



2) Do you feel that the three consultants did an acceptable job of conducting 
the project? 

a) Yes, the information that each gave was well worth it. I feel we should 
go on with out meeting with staff. Board of Education, parents, and tneet 
back Viiith you about the 1st of June* 

b) The presentations were good and also the backup help. 

c) Yes, wish that there could be more time to pursue with the experts what 
we have started. At least > you have given the impetus. 

d) Yes, especially Mr. Fisher who had the knowledge of the objectives of 
tests and possible fallacies* Also he suggested ways for effective 
communication, also possible pitfalls. 

e) Yes, they were free, willing and able to answer questions concerning 
roe in the area of communications and assessment, 

f) Yes, things were explained well ^ and we were given ample time to ask 
any questions. Our tasks were clearly stated, and 1 think the group 
felt comfortable in expressing their concerns. 

g) The consultants did a good job with the presentation. It was interesting 
and informative as well as flexible when probing questions were asked. 

It would be wise if all administrative teams for schools thi^ughout the 
state could be exposed to this team and its material* 

h) Yes, the purposes or objectives in mind each time were clearly presented. 
There was always time for feedback, questions, and help or clarifica- 
tions. 

i) Yes, greatly appreciated Tom's contribution. Like Erwin^s explanation 
and printed materials. 

3) Do you feel that you understand the basic eL^ments of communication theory 
we presented? 

. a) Yes and no. The time will tell as to what kind of job of communication 
that I will do. 

Thaftks again for all the help. 

b) After being involved with the first three sessions I dould see the value 
of the presentations and the need for such work in this area. 

believe that aside from the presentation and discussion, very 
valuable and useful tool in my possession is the booklet Keeping the 
Public Informed; Accent on Accountability. 

d) Yes, because although I f^el 1 can communicate fairly well. A system- 
atic system to organize a communication approach was very valuable, 
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Evaluation Questions 
Page 3 



e) Yes and no. I still feel somewhat "frizzy." Answering the questionnaire 
will perhaps clear up "things." 

f) Yes, I think I knew some of the basic elements of communications before 
these meetings, but felt I either learned some new elements or had 
othert; reinforced. 

g) I feel that I understand the material well enough to dig out the infor- 
mation as I need it. 

h) Yes, this area would aid us for any time of presentation of any proposal 
or information. Taking the time to go through this made me more con- 
fident and knowledgeable to meet my different publics. 

i) Yes, found that going through the suggested steps (work sheets) helped 
with my building presentation. Booklet was very interesting. 



